Web Survey Bibliography
Grids have been the subject of significant research as a frequently used—but often problematic—way to present multiple questions in a shared layout, particularly within Web-based surveys. Respondents’ increasing use of mobile devices underscores and emphasizes the need to reexamine design standards for grids and questionnaires that will now be seen on a variety of screen types. While recent work has begun to explore the relationship between device use, data quality (McClain, Crawford, & Dugan, 2012; Saunders et al., 2012), and substantive responses (Mavletova & Couper, 2012), considerable practical concerns remain in conducting surveys that have been optimized for larger screens. Drawing upon recent literature and paradata that we have collected, we propose a combined layout and questionnaire design approach to confronting these challenges-- acknowledging that while refining layout and user design of grids can impact data quality (Couper et al., 2013) and aid mobile navigation, an additional challenge lies in designing questionnaires that are clear, cohesive, and adaptable to the smaller screen space available on mobile devices. To better understand interactions between device use and data quality measures in a grid-heavy setting, we reviewed respondent behavior and characteristics of grids from multi-year administrations of 11 Web surveys with college student populations, spanning several hundred thousand respondents. We focused our exploration on key contextual characteristics of grids that may influence data quality and exacerbate burden--such as questionnaire position/context, grid length and density, scale design, sensitivity of content, and presence of validations. Specifically, we investigate the relationship between several of these characteristics and mobile respondents’ tendency to straightline, as a potential indicator of satisficing (Krosnick, 1991); to break off; and to yield higher rates of item-missing data. Our presentation will highlight key findings from this analysis and discuss implications for questionnaire design that considers the mobile space.
Conference Homepage (abstract)
Web survey bibliography (4086)
- Mode Effects in a National Establishment Survey; 2013; Daley, K., Phillips, B. T.
- Cognitive Interviewing in Online Modes: a Comparison of Data Collected in Second Life and Skype; 2013; Swicegood, J. E., Head, B., Dean, E., Keating, M.
- Mobile Browser Web Surveys: Testing Response Rates, Data Quality and Best Practices; 2013; McGeeney, K., Marlar, J.
- Comparing Tablet, Computer, and Smartphone Survey Administrations; 2013; Wells, T., Bailey, J., Link, M. W.
- Speeding and Non-Differentiation in Web Surveys: Evidence of Correlation and Strategies for Reduction...; 2013; Zhang, Che.
- Use of Drag-and-Drop Rating Scales in Web Surveys and Its Effect on Survey Reports and Data Quality; 2013; Kunz, T.
- Effects of Respondent Reluctance, Mode, and Technical Difficulties on Straight- Lining and Refusals...; 2013; Gibson, J. L., Mendelson, J.
- The Relations Among Different Cognitive Shortcuts in Surveys; 2013; Tourangeau, R., Medway, R., Presser, S.
- Differential Incentives in a Dual Mode Survey of Health Care Providers; 2013; Roff, B., Barrett, K.
- Effects of Displaying Videos on Measurement in a Web Survey; 2013; Mendelson, J., Gibson, J. L., Romano Bergstrom, J. C.
- The Effect of Attempting to Recruit Respondents to a Web-Based Diary on Overall Response Rate; 2013; Cantave, M. A. Gentry, R. J.
- Watch Your Language!: The Impact of the Survey Language on Bilingual Hispanics’ Response Process...; 2013; Ay, M., Gross, W., Cobb, C. L., Thomas, R. K.
- Estimation of Expected Academic Engagement Behaviors: The Use of Vague Quantifiers Versus Tallied Responses...; 2013; Cole, J.
- Self-Reported Participation in Research Practices Among Survey Methodology Researchers; 2013; Perez-Vergara, K., Smith, C., Lowenstein, C., Ozonoff, A., Martins, Y.
- Changing of the Guard: Effects of Different Self-Administered Survey Modes on Sensitive Questions; 2013; Barlas, F. M., Higgins, W. B., Pflieger, J., Thomas, R. K., Jeffery, D., Mattiko, M.
- Estimating Measurement Effects of Survey Modes From Between and Within Subject Designs; 2013; Klausch, L. T., Hox, J., Schouten, B.
- Web Versus Outbound: A Mode Face-Off Following the Presidential Debate; 2013; Marlar, J.
- Innovative Retention Methods in Panel Research: Can SmartPhones Improve Long-Term Panel Participation...; 2013; Dayton, J. J., Dyer, A.
- Predicting Survey Breakoff in Internet Survey Panels; 2013; Al Baghal, T., McCutcheon, A. L., Tsabutashvili, D.
- Using GIS to Target Address-Based Samples of Households for a Web (vs. Mail) Response: Evidence from...; 2013; Messer, B. L.
- Is Pushing the General Public to the Web in Address-Based Samples Cost Effective?; 2013; Lesser, V. M.
- Effects of Survey Sponsorship on Internet and Mail Response: Using Address- Based Sampling; 2013; Edwards, M. L.
- Grid Formats, Data Quality, and Mobile Device Use: A Questionnaire Design Approach; 2013; McClain, C., Crawford, S. D.
- Can Embedded Help Text Links in Web Survey Items Improve Data Quality?; 2013; Janson, N., Bennett, C., Caves, L., Cominole, M., Shepherd, B., Wine, J.
- Using the iPad as a Prize-Based Incentive to Boost Response Rates: A Case Study at Brigham Young University...; 2013; McClendon, R., Olsen, D.
- Can Google Consumer Surveys Help Pre-Test Alternative Versions of a Survey Question?: A Comparison of...; 2013; Stern, M. J., Welch, W. W.
- Online Panels: Recruitment Based on “Hot Topics” – What are the Consequences?; 2013; Andreasson, M., Martinsson, J.
- Social Network Analysis and Survey Response: How Facebook Data Can Supplement Survey Data; 2013; Sage, A.
- Surveywalls: A Breakthrough for Survey Customers or DIY Run Amok?; 2013; Wells, T., Dean, E., Rao, K., Murphy, J., Roe, D. J.
- Examining the Effects of Interventions to Obtain Participation via Less Expensive Modes: Results from...; 2013; Harris-Kojetin, L., Sengupta, M., Hobbs, M., Greene, A.
- Evaluating the Effect of a Non-Monetary Incentive in a Nationally Representative Mixed-Mode Establishment...; 2013; Sengupta, M., Harris-Kojetin, L., Hobbs, M., Greene, A.
- Dynamic Visual Design for List-Style Open-Ended Questions in Web Surveys; 2013; Fuchs, M.
- Classifying Mouse Movements to Predict Respondent Difficulty; 2013; Horwitz, R.
- Are You Seeing What I am Seeing? Exploring Response Option Visual Design Effects With Eye-Tracking; 2013; Libman, A., Smyth, J. D., Olson, K.
- Evaluating Interactive Feedback in Computer-Assisted Self-Interviewing (CASI); 2013; Hudson, M. L., Hupp, A., Zhang, C., Schroeder, H. M.
- Effective e-incentive for Online Study: Comparing Branded e-Gift Card and Virtual Cash Card; 2013; Jin, T., Duan, S., Lai, J. W., Link, M. W.
- First Contact Strategies for Web Surveys: Is a Phone Call or a Letter the More Effective Introduction...; 2013; Connelly, J., Sjoblom, M., Datta, R., Scholfield Hepburn, P.
- Response Format Effects in the Measurement of Employment; 2013; Rodkin, S., Thomas, R. K., Subias, S., Chu, C.
- Impact of Filter Questions on Estimates of Media Consumption; 2013; Cobb, C. L., Godinez, D., Thomas, R. K., Baim, J.
- The Effect of Survey Mode on Nonresponse Bias and Measurement Error: A Validation Approach; 2013; Kirchner, A., Felderer, B.
- Cross-Platform Measurement: User Experience With a Smartphone and Web Self- Reported Data Collection...; 2013; Petras, A. P., Duan, S., Dan, O.
- How Far Have We Come? The Lingering Digital Divide and Its Impact on the Representativeness of Internet...; 2013; Dennis, J. M., Cobb, C. L.
- How Do Different Sampling Techniques Perform in a Web-Only Survey? Results From a Comparison of a Random...; 2013; Bilgen, I., Stern, M. J., Wolter, K.
- Are Response Rates to a Web-Only Survey Spatially Clustered?; 2013; Fiorio, L., Stern, M. J., English, N., Bilgen, I., Curtis, B.
- The Effectiveness of Mailed Invitations for Web Surveys; 2013; Bandilla, W., Couper, M. P., Kaczmirek, L.
- Examining the Feasibility of SMS as a Contact Mode for a College Student Survey; 2013; Crawford, S. D., McClain, C., O'Brien, S., Nelson, T. F.
- The Impact on Web Survey Drop-Out Rates of Page Number Progress Indicators Used Throughout, Near the...; 2013; Walston, J. T., Cunningham, B., Medway, R.
- Survey Reminder Method Experiment: An Examination of Cost Efficiency and Reminder Mode Salience in the...; 2013; Anderson, M., Rogers, B., CyBulski, K., Hall, J. W., Alderks, C. E., Milazzo-Sayre, L.
- Using Qualitative and Quantitative Testing to Improve Hispanic Response Rates for Online Surveys; 2013; Pens, Y., Gentry, R. J.
- The Use of Email, Text Messages, and Facebook to Increase Response Rates Among Adolescents in a Longitudinal...; 2013; Fleeman, A., Francis, K., Henderson, Ti., Woodford, M., Jani, M.